Best Inference Computing AI Tools & Models - Premium Inference Computing News

AI News

Powerful Collaboration: Micron Joins Anthropic to Build the Next Generation of AI Infrastructure

Micron and Anthropic form a strategic alliance to co-develop AI memory architectures, technologies, and supply chains, targeting HBM, DRAM, and SSDs for AI training and inference, signaling a shift in computing competition to hardware.....

8.1k 7 minutes ago

Investing in Domestic Computing Power: ByteDance Plans to Purchase 50,000 AI Chips, the Domestic GPU Industry Gains a New Major Player

ByteDance plans to negotiate with domestic high-performance computing firm Tianshu Zhixin for a large-scale purchase of about 50,000 AI chips, primarily for inference tasks to support the iteration and user growth of its AI chatbot 'Doubao'. This move reflects that, amid expanding AI large model user bases, self-controllable computing infrastructure has become a strategic priority for tech companies.....

18.2k 1 hours ago

OpenAI Invests Heavily in AI Computing Power, 50 Billion Dollar Investment Sparks Industry Arms Race

OpenAI CEO Greg Brockman revealed that the company plans to invest up to 50 billion dollars before 2026 to enhance computing resources, in response to the surge in demand for computing power for training and inference of large AI models. This investment has grown thousands of times compared to around 30 million dollars in 2017, marking the transition of generative AI from experimental stages to large-scale commercialization.

15.2k 4 days ago

OpenAI Invests Heavily in AI Computing Power, 50 Billion Dollar Investment Sparks Industry Arms Race

New Breakthrough in Domestic GPU: Moortech S5000 Supports China Mobile's Jiutian Large Model

At the 9th Digital China Construction Summit, China Mobile will publicly showcase its self-developed "Jiutian" 35B general large model for the first time. Moortech announced that its flagship GPU MTTS 5000 has completed full-process adaptation and inference verification for this model, marking an important breakthrough in the domestic computing power ecosystem. Through its self-developed MUSA software stack and the high-performance inference engine SGLang-MUSA, Moortech has achieved deep integration and optimization throughout the entire inference pipeline of the "Jiutian" 35B model.

12.5k 4 days ago

New Breakthrough in Domestic GPU: Moortech S5000 Supports China Mobile's Jiutian Large Model

AI Products

MTIA

Meta Training and Inference Accelerator (MTIA) is Meta's self-developed next-generation AI training and inference acceleration chip. Compared to the previous generation, MTIA v2 has significantly improved computing power and memory bandwidth, enabling more efficient support for Meta's sorting and recommendation model applications. This is a significant achievement in Meta's continuous investment in self-developed hardware infrastructure, which will bring new capabilities to Meta's AI products and services.

Hardware infrastructure

9.4k

Models

Grok 4 Fast

Xai

$1.4

Input tokens/M

$3.5

Output tokens/M

Context Length

o3-mini

Openai

$7.7

Input tokens/M

$30.8

Output tokens/M

200

Context Length

Claude Haiku 4.5

Anthropic

Input tokens/M

$35

Output tokens/M

200

Context Length

Gemini 2.5 Flash

Google

$2.1

Input tokens/M

$17.5

Output tokens/M

Context Length

Gemini 2.5 Flash-Lite

Google

$0.7

Input tokens/M

$2.8

Output tokens/M

Context Length

Qianfan-Lightning

Baidu

Input tokens/M

Output tokens/M

128

Context Length

Qwen3-Next-80B-A3B-Instruct

Alibaba

Input tokens/M

Output tokens/M

256

Context Length

Doubao-1.5-pro-32k

Bytedance

$0.8

Input tokens/M

Output tokens/M

128

Context Length

Hunyuan-T1-20250822

Tencent

Input tokens/M

Output tokens/M

Context Length

Hunyuan-T1-latest

Tencent

Input tokens/M

Output tokens/M

Context Length

DeepSeek-V3.1

Deepseek

Input tokens/M

$12

Output tokens/M

128

Context Length

Qwen3-1.7B

Alibaba

Input tokens/M

Output tokens/M

Context Length

gpt-oss-20b

Openai

$0.4

Input tokens/M

Output tokens/M

128

Context Length

GPT-5 mini

Openai

$1.75

Input tokens/M

$14

Output tokens/M

400

Context Length

GPT-5 nano

Openai

$0.35

Input tokens/M

$2.8

Output tokens/M

400

Context Length

Qwen3-235B-A22B-Instruct-2507

Alibaba

Input tokens/M

Output tokens/M

Context Length

Pangu-NLP-N2-128K-5.0.1.1

Huawei

Input tokens/M

Output tokens/M

128

Context Length

Pangu-NLP-N2-32K-5.0.1.1

Huawei

Input tokens/M

Output tokens/M

Context Length

GLM-4.5-Flash

Chatglm

Input tokens/M

Output tokens/M

128

Context Length

GLM-4.5-AirX

Chatglm

Input tokens/M

Output tokens/M

128

Context Length

Empowering the future, your artificial intelligence solution think tank

English 简体中文繁體中文にほんご

FirendLinks:

AI Newsletters AI Tools MCP Servers AI News AI Marketing LLM Leaderboard AI Ranking

Business Cooperation Site Map

AI News

Powerful Collaboration: Micron Joins Anthropic to Build the Next Generation of AI Infrastructure

Investing in Domestic Computing Power: ByteDance Plans to Purchase 50,000 AI Chips, the Domestic GPU Industry Gains a New Major Player

OpenAI Invests Heavily in AI Computing Power, 50 Billion Dollar Investment Sparks Industry Arms Race

New Breakthrough in Domestic GPU: Moortech S5000 Supports China Mobile's Jiutian Large Model

AI Products

MTIA

Models

Grok 4 Fast

o3-mini

Claude Haiku 4.5

Gemini 2.5 Flash

Gemini 2.5 Flash-Lite

Qianfan-Lightning

Qwen3-Next-80B-A3B-Instruct

Doubao-1.5-pro-32k

Hunyuan-T1-20250822

Hunyuan-T1-latest

DeepSeek-V3.1

Qwen3-1.7B

gpt-oss-20b

GPT-5 mini

GPT-5 nano

Qwen3-235B-A22B-Instruct-2507

Pangu-NLP-N2-128K-5.0.1.1

Pangu-NLP-N2-32K-5.0.1.1

GLM-4.5-Flash

GLM-4.5-AirX

Kimi K2 Thinking MLX 4.25bit

DeepSeek R1 0528 Qwen3 8B GGUF

Llama 3 8b Quantized